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The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136 (a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will 

be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this 

communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Status 

1 )□ Responsive to communication(s) filed on 11/01/00 . 

2a)D This action is FINAL. 2b)EI This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 11; 453 O.G. 213. 

Disposition of Claims 

4) [X] Claim(s) 1-9: 11-37; 39 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) 13 Claim(s) 1-9; 11-37:39 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) Q Claims are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are objected to by the Examiner. 

1 1) D The proposed drawing correction filed on is: a)D approved b)D disapproved. 

12) D The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 119 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d). 

a)D All b)Q Some * c)Q None of the CERTIFIED copies of the priority documents have been: 

1. Q received. 

2. D received in Application No. (Series Code / Serial Number) . 

3-D received in this National Stage application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgement is made of a claim for domestic priority under 35 U.S.C. & 119(e). 
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DETAILED ACTION 
Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

1. Claims 1-3,6,9, 13, 16-19, 21-28, 31, 33-34, and 36 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over French St. George et al. (US Patent No. 6,018,71 1), as used in the 
first Action, in view of Salazar et al. (US Patent No. 5,774,841), newly cited 

2. Regarding claims 1, 2, 9, 13, 16-19, 21, 22, 23, 25-28, 33, 34, 36 "speech recognition 
engine to recognize an utterance.. .listen for the utterance for a predetermined response time..." is 
taught by St. George at col. 6, lines 9-67 continuing to col. 9, lines 1-19; 

"...user interface configured ...to display a countdown graphic that changes with lapsing 
of the response time" is taught by St. George at col. 6, lines 9-67 continuing to col. 9, lines 1-19; 

St. George does not teach "...user interface configured to play an audible sound indicating 
recognition of the utterance" or "a user interface to provide visual and auditory feedback 
indicating whether the speech recognition engine recognizes the utterance". However, refer to 
Salazar et al. who teach an adaptive speech recognition command and control apparatus and 
method which provides audio and visual feedback to the user upon the recognition or none 
recognition of user input utterances (col. 3, lines 58-67 continuing to col. 4, lines 1-17; col. 7, 
lines 18-55; and col. 1 1, lines 4-35) 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the user interface for a speech recognition system of St George to implement 
providing feedback to the user of a speech recognition system as taught by Salazar et al. because 
such a modification would ensure the user the recognition system was functioning properly and 
that the system vocabulary was current. 

St. George teach that their system interface is applicable or usable in a plurality of 
networks, systems, communication devices, terminals and platforms (see col. 6, lines 9-16, and 
col. 9', lines 3-18). 

Neither St. George nor Salazar et al. teach the "user interface restarts countdown graphic 
in the event the speech recognition engine recognizes the utterance." However, it would have 
been obvious to modify the user interface system of St. George '711 to implement visual and 
auditory feedback as taught by Salazar et al, and to further modify the system to allow for the 
user interface restarting the countdown graphic, because such a modification would continually 
grant the user the maximum response time for generating an utterance to be recognized, which 
would improve the usability and flexibility of the system. 

3. Regarding claim 3, "..response time is configurable.." is taught by St. George at col. 7, 
lines 9-21. 

4. Regarding claims 6, 14, 24, 3 1 , and 39, "...user interface plays sound when the response 
time has elapsed" is taught by St. George at col. 8, line 67 continuing to col. 9, lines 1-3. 
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Claims 4-5, 7-8, 1 1-12, 15, 20, 29-30, 32, 35, and 37 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over French St. George et al. (US Patent No. 6,018,71 1) in view of 
Salazar et al. (US Patent 5,774,841) as applied to claims 1, 9, 18, 23, 27 and 34 above, and 
further in view of VanBuskirk et al. (US Patent No. 6,075,534). 

5. Regarding claims 4, 1 1, 20, 29, and 37, neither St. George nor Salazar et al. teach 
"...interface displays visual elements in a first color..." However, refer to VanBuskirk et al. Who 
teach a user interface for a speech recognition system which implements a minibar graphic that is 
used to provide status information of the functions of the recognition system via changing of the 
color of the graphic or a moving ribbon (refer to Figures 1 A-7 and col. 4, lines 12-33). 

Therefore, it would have been obvious to one of ordinary skill to modify the speech 
recognition user interface of St. George to implement the changing of the graphic color of 
VanBuskirk et al., for the purpose of providing the user with more options in how they can 
monitor utterance input response time. 

6. Regarding claims 5, 12, 30, and 35, "...countdown bar comprises a progress bar." neither 
St. George 'nor Salazar et al. teach "...countdown bar comprises a progress bar..." However, 
refer to VanBuskirk et al. Who teach a user interface for a speech recognition system which 
implements a minibar graphic that is used to provide status information of the functions of the 
recognition system via changing of the color of the graphic or a moving ribbon (refer to Figures 
1A-7 and col. 4, lines 12-33). 
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Therefore, it would have been obvious to one of ordinary skill to modify the speech 
recognition user interface of St. George to implement moving ribbon (applicant's progress bar) 
of VanBuskirk et al., for the purpose of providing the user with more options in how they can 
monitor utterance input response time. 

7. Regarding claims 7, 15, 32, neither St. George nor Salazar et al. teach "...sleep 
mode. ..awakened to an active mode upon detection of starter utterance" However, refer to 
VanBuskirk et al. Who teach a user interface for a speech recognition system which implements 
a minibar graphic that is used to provide status information of the functions of the recognition 
system via indicating that the system is in sleep mode and can be awakened by either saying a 
proper command or by manual means (refer to col. 4, lines 42-51. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the user interface of St. George to implement the sleep/awaken methods of 
VanBuskirk et al., for the purpose of ensuring the user's utterance is captured in a hands-busy 
environment. 

8. Regarding claims 8 neither St. George nor Salazar et al. teach "...sleep mode.. .awakened 
to an active mode upon depression of a button". However, refer to VanBuskirk et al. Who teach a 
user interface for a speech recognition system which implements a minibar graphic that is used 
to provide status information of the functions of the recognition system via indicating that the 
system is in sleep mode and can be awakened by either saying a proper command or by manual 
means (refer to col. 4, lines 42-51. 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the user interface of St. George to implement the sleep/awaken methods of 
VanBuskirk et al., for the purpose of providing the user with more control over when the system 
is activated and to safeguard against the system responding to extraneous noise. 

Response to Arguments 
Applicant's arguments with respect to claims 1-9, 1 1-37, and 39 have been considered but 
are moot in view of the new ground(s) of rejection. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 703-308-6258. 
The examiner can normally be reached on Monday-Thursday 7:30-5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William R. Korzuch can be reached on 703-305-6137. The fax phone numbers for 
the organization where this application or proceeding is assigned are 703-308-6306 for regular 
communications and 703-308-6296 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-3900. 



AAA 

January 16, 2001 




